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Abstract 

We consider the mutual interactions, via cytokine exchanges, among helper lymphocytes, B lympho- 
cytes and killer lymphocytes, and we model them as a unique system by means of a tripartite network. 
Each part includes all the different clones of the same lymphatic subpopulation, whose couplings to the 
others are either excitatory or inhibitory (mirroring clicitation and suppression by cytokine). First of 
all, we show that this system can be mapped into an associative neural network, where helper cells 
directly interact with each other and are able to secrete cytokines according to "strategies" learnt by 
the system and profitable to cope with possible antigenic stimulation; the ability of such a retrieval 
corresponds to a healthy reaction of the immune system. We then investigate the possible conditions for 
the failure of a correct retrieval and distinguish between the following outcomes: massive lymphocyte 
expansion/suppression (e.g. lymphoproliferative syndromes), subpopulation unbalance (e.g. HIV, EBV 
infections) and ageing (thought of as noise growth) ; the correlation of such states to auto-immune diseases 
is also highlighted. Lastly, we discuss how self-regulatory effects within each effector branch (i.e. B and 
killer lymphocytes) can bo modeled in terms of a stochastic process, ultimately providing a consistent 
bridge between the tripartite-network approach introduced here and the immune networks developed in 
the last decades. 
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1 Introduction 

The immune system is one of the most advanced and complex biological systems, made up of many different 
kinds of cells, and hundreds of different chemical messengers, which must be properly orchestrated for 
ensuring a safe collective performance, that is, to protect the host body against foreign organisms and 
substances, also recognizing objects as cither damaging or non-damaging. The system includes different 
classes of cells working as "soldiers" and different classes of proteins working as "weapons", each carrying out 
specialized functions (e.g. alert, activate, engulf, kill, clean up, etc.); all the immune cells synthesize and 
secrete special proteins that act as antibodies, regulators, helpers or suppressors of other cells in the whole 
process of defending against invaders. 

Like the nervous system, the immune system performs pattern recognition, learns and retains a memory 
of the antigens that it has fought off. Accomplishing such complex tasks requires the cooperation (via cell- 
to-cell contacts and exchanges of secreted messengers) among a huge number of components and this allows 
for using the methods and the concepts of statistical mechanics. Indeed, a systemic viewpoint, embedded in 
a statistical mechanics framework, may be a strategic approach to evidence which are the key mechanisms 
underlining the (mis)functioning of the system and therefore to prevent diseases and derangements. 
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Basically, the architecture of the model we introduce keeps track of the (manifest) interactions among 
agents, while statistical mechanics gives the rules, through thermodynamical variational principles, and 
ultimately allows to uncover the key mechanism and, possibly, hidden correlations. 

Beyond a general picture, the particular phenomenon we want to deepen and explain in terms of a co- 
operative behavior of immune cells is the emergence and the effects of lymphocytosis (i.e. an abnormal 
immune response by lymphocytes) : The correlation between a strong lymphocytosis and autoimmune mani- 
festations is a well-known experimental finding for which a plethora of interpretations and descriptions have 
been provided, yet a unifying, sytematic picture is still missing [H |21 El HI El EJ [7] ■ Essentially, two types of 
lymphocytosis exist: as a response to a pathogen (i.e. Epstein-Barr virus, EBV, or Human immunodeficiency 
virus, HIV, etc), which may affect the host for a while and then disappear, becoming latent (and is cou- 
pled with a short term or pulsed autoimmunity) [5J |3] , and as Autoimmune Lymphoproliferative Syndrome 
(ALPS), a chronic lymphocytosis due to the lack, in killer cells, of the Fas genetic expression, a regulatory 
intracellular mechanism that induces the apoptosis |10[ [TT] . ALPS is a severe disease which develops in 
strong, persistent, autoimmune manifestations and, despite well understood at micro (genetic) and macro 
(clinical) levels of description, a consistent, merging description is still missing [12 . 

The model we introduce includes effector cells (killer lymphocytes Tk and B cells) and helper cells 
Tfj; whose mutual interactions, occurring via cytokines exchange, give rise to a network, where helpers are 
connected to both effector cells (B, Tk), while there is no direct connection among the latter. Since the effect 
of cytokines exchanged can be either excitatory or inhibitory, this realizes a tripartite spin-glass system. We 
firstly show that such a system is equivalent to an associative neural network where helper cells are able, 
thanks to a cooperative synergy, to perform retrieval of "strategies" learnt by the system and profitable to 
cope with possible antigenic stimulation. Hence, the ability of such a retrieval corresponds to a healthy 
reaction of the immune system. 

A state of poly-clonal lymphocytosis is then realized by increasing the average size of effector popula- 
tions, hence mimicking a persistent clonal expansion. Interestingly, we find that this alteration is formally 
equivalent to a random field acting on helper cells, which induces "disorder" within the system. As we will 
explain, this can be read from a thermodynamic perspective: The presence of a (sufficiently large) antigenic 
concentration induces the system to do some "work" (a clonal expansion), which turns out to be split in 
an internal energy term (necessary to make the network able to recognize) and in a heat term (emerging 
as an unavoidably feature of this conversion). Otherwise stated, it is not possible to obtain an extensive 
immune response (a clonal expansion of B or Tk cells) , which play the role of a "work" (as it is an ordered 
result), without introducing some noise (heat) in the network of interacting cells, the whole resembling the 
well known principles of thermodynamics. 

Furthermore, we find that the average extent of effector population must range within a given interval 
in order for the system to be performing: If the population is too small, the interplay among components is 
too weak in order to establish a mutual interaction and regulation; on the contrary, if, e.g. due to a strong 
immune response, the population gets too large, the level of noise in the network may become so high that 
the system starts to fail to select the right strategies to fight, and ultimately, it attacks the self, producing 
the autoimmune response. Similarly, we will show that if the balance between lymphocyte sub-populations is 
lost (as it happens in HIV and EBV infections) , another kind of "noise" prevails and, again, the system is no 
longer able to work correctly. Bad signaling can also prevail due to a progressive growth of the randomness 
in the stochastic process we consider; increasing white noise corresponds to an aging process, consistently 
with the evidenced malfunctioning of elder systems: Debris from e.g. lysis of infected cells by killers, may 
act as "dust" in the 'gears" of pattern recognitions. 

Hence, our model highlights three ways to escape from the "healthy region": massive clonal expan- 
sion/suppression, unbalance in subpopulations, aging. Despite not yet quantitatively comparable to real 
data, a clear theory of this mechanism opens completely new paths to deal with autoimmune diseases, which 
affects almost one fourth of the worldwide population [T3] . 

The paper is organized as follows: in Sec. 2 we describe, from an immunological point of view, the agents 
making up the system we are focusing on; in Sec. 3 we describe in details the formal model used to describe 
the system itself, and in Sec. 4 we analyze its behavior, stressing the conditions leading to an incorrect 
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performance; our conclusions and perspectives are collected in Sec. 5. The technical passages involved in 
the statistical mechanics analysis of our model are gathered in the appendices, together with a discussion on 
the hidden effects of mutual interactions within the effector branches. 

2 The immunological scenario 

The system we are focusing on provides a modeling for the interplay among lymphocytes (B cells, Tk cells 
and Th cells) mediated by cytokines (interleukin family, interferon family, etc.); before proceeding, we sketch 
the main functions of such agents [T and of some pathologies (e.g. HIV infection or ALPS), which stem 
from an improper functioning of these agents. 

B lymphocytes. The main role of these cells is to make antibodies (primarily against antigens Q and to 
develop into memory B cells after activation by antigen interaction. When receptors on the surface of a B 
cell match the antigens present in the body, the B cell (aided by helper T cells) proliferates and differentiates 
into effector cells, which secrete antibodies with binding sites identical to those displayed by receptors on 
the ancestor-cell surface (hypersomatic mutation apart [1 ), and into memory cells, which survive for years 
preserving the ability to recognize the same antigen during a possible re-exposure. According to the shape 
of the receptors they display, B cells are divided into clones: cells belonging to the same clone can recognize 
and bind the same specific macromolecules (epitopes) of a given antigen. A set of up to 10^ different clones 
allows for deeply diverse and specific immune responses. 

Another important role of B cells is to perform as antigen-presenting cells (APC) to other agents; this 
makes B cells able to interact with (mature) T cells, through the so-called "immunological synapse". Indeed, 
the recognition of an antigen is not sufficient for B cell activation: An additional signal from helper T cells 
is in order and this is realized by means of chemical messengers (cytochines, see below) secreted by the 
matching T cell [H] . 

Tk lymphocytes. Cytotoxic CD8+ cells (also known as "Killer cells") belong to the group of T lym- 
phocytes. Tk cells are capable of inducing the death of infected, tumoral, damaged or dysfunctional cells. 
Analogously to B cells, the activation of cytotoxic T cells requires not only the presence of the antigen, but 
also a second signal provided by the cytokines released from helper T cells. 

In fact, cytotoxic T cells express receptors (TCRs) that can recognize a specific antigenic peptide bound 
to the so called class-I MHC molecules (present on nearly every cell of the body) ; upon recognition CD8+ 
cells are regulated by the chemical messengers (cytochines, see below) secreted by active helper T cells. More 
precisely, CD8+ cells undergo clonal expansion and differentiation into memory and effector cells with the 
help of a cytokine called Interleukin-2; as a result, the number of effector cells for the target antigen increases 
and they can then travel throughout the body in search of antigen-positive cells. 

Th lymphocytes. Helper CD4+ cells are a sub-group of T lymphocytes that play a crucial role in 
optimizing the performance of the immune system. These cells do not posses cytotoxic or phagocytic activity, 
neither they can produce antibodies, yet, they are actually fundamental for regulation of the effector branches 
of the immunity and this job is basically accomplished by secretion and absorbtion of cytokines. 

CD4+ T cells exhibit TCRs with high affinity for the so called class-II MHC proteins, generally found on 
the surface of specialized APCs, e.g. dendritic cells, macrophages and B cells. The presentation of antigenic 
peptides from APCs to CD4+ T cells provides the first signal, which ensures that only a T cell with a 
TCR specific to that peptide is activated. The second signal involves an interaction between specific surface 
receptors on the CD4+ and on APC and it licenses the T cell to respond to an antigen. Without it, the T 
cell becomes anergic, and does not respond to any antigen stimulation, even if both signals are present later 
on. This mechanism prevents inappropriate responses to self, as self-peptides are not usually presented with 
suitable co-stimulations [15J. 

healthy immune system produces also a small amount of self-reactive lymphocytes, whose antibody production is low 
and regulated by the network of cells making up the whole system, so that it is not dangerous for the host body [T]. 
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Once the two signal activation is complete, the T helper cell proliferates and releases and/or absorbs 
regulatory agents called cytokines, then they differentiate into the subfamilies Thi or depending on 
cytokine environment (however for our purposes this further distinction is not needed) . 

Cytokines. Cytokines are small cell-signaling proteins secreted and absorbed by numerous cells of the 
immune system, functioning as intercellular messengers: Cytokines include e.g. interleukins, interferons and 
chemochines. 

These are usually produced by stimulated cells and are able to modify the behavior of secreting cells 
themselves (autocrine effect) or of others (paracrine effect), not necessarily spatially close (endocrine effect), 
inducing growth, differentiation or death. Most cytokines are produced by CD4+ cells and to a lesser degree 
by monocytes and macrophages. In general, cytokines display both agonist and antagonist action in such a 
way that if the pro-inflammatory milieu exceeds that of the anti-inflammatory mediators the net effect will 
result in prolonged inflammation. 

Moreover, cytokines attach to receptors on the outside of cells causing the target cell to produce other 
cytokines; this complicated relationship is called the cytokine network, and it is one of the most important 
ways used by the immune system, spread throughout the body, to communicate and orchestrate appropriate 
responses to the various challenges. Indeed, cytokines act as key communicators for immune cells and the 
delicate balance in the level of these communicators is vital for health: Many chronic diseases arise due to 
a disruption of this balance |16| . 

In fact, plasma levels of various cytokines may give information on the presence of inflammatory processes 
involved in autoimmune diseases such as rheumatoid arthritis, as well as immunomodulatory effects of foods 
or drugs; in addition, cytokines play an important part in the progression from HIV infection to AIDS 
disease and in many AIDS-related illnesses: In particular, the initial HIV infection disrupts the normal 
balance of cytokines by causing the levels of certain cytokines to rise; cytokine imbalances then helps HIV to 
target CD4+ cells and the lymph nodes, leading to the progressive immunosuppression and the opportunistic 
infections that follow [HI HZj . 

Autoimmune diseases. These pathologies stem from a failure of the immune system to recognize its host 
body as self, and this causes an immune response against host's own cells and tissues |2 |3J H] |5J El [Z]. 
In the early development of theoretical immunology the main strand to tackle the problem of self/non-self 
discrimination by immune cells was the clonal deletion: In the bone-marrow (for the B) or in the thymus 
(for the T) all the cells are tested and those self-reacting are deleted in such a way that cells making up 
the effective repertoire are only those specific for foreign antigens. Actually, it is now established (both 
experimentally and theoretically) that a low level of self-reactivity is normal and even necessary for the 
immune system to work properly. From a systemic point of view it is just the synergic interplay between 
immune agents, in particular cytokines, immunoglobulins and lymphocytes, that keeps the concentrations of 
self-reactive cells at the right values |31 [HI UHl [H] . 

Lymphocytosis. Lymphocytosis refers to an abnormal increase in the count of white cells (i.e. > 10^ 
cells/litre jlj), sometimes evolving in chronic lymphocytic leukemia. Lymphocytosis can be essentially of two 
types, either mono-clonal or poly-clonal, referring to the expansion of a particular clone or of an ensemble; 
in this work we deal with the latter. This pathology essentially happens as a response to particularly 
"smart" antigens (i.e. EBV, HIV, etc), as a chronic condition of long term infections (i.e. tuberculosis, 
brucellosis, syphilis), from malignancies (i.e. leukemia) or, lastly, due to a genetic alteration causing the lack 
of lymphocyte apoptosis after their clonal expansion (autoimmune lymphoproliferative syndrome, ALPS). 
More precisely, ALPS patients have been found to carry mutations in genes Fas and FasL, which are upstream 
effectors of the apoptotic pathway |10l 111] . This inefhcacy of apoptosis causes an increase in the number 
of lymphocytes in the body, including cells that are too old and less effective, and a consequential bad 
regulation of cytokines secretion |20l [5TJ [51]. As a result, there is the failure of immunological homeostasis, 
possibly leading to autoimmunity, and the development of lymphoma. ALPS can be diagnosed by blood 
tests; it occurs in both sexes and has been described in patients (mostly children) from all over the world. 
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Figure 1: (Color on line) Schematic representation of the tripartite system considered. Each node envisages 
a set of B,H,K different clones of B, CD4+ and CD8+ cells respectively. The activity of each clone is 
described by a dichotomic variable hi or by a Gaussian variable bi and ki centered around a value ko and 60 j 
respectively. 



ALPS is a rare condition which has been defined only within the past few years; its incidence has not yet 
been estimated pglEi] . 

3 The model 

As anticipated, the protagonists of our model are B cells (which produce antibodies). CD8+ cells ("killers" 
which delete infected cells), and CD4+ cells ("helpers" which coordinate the two effector branches) of the 
immune response. Each type is constituted by clones with a given specificity and the overall number of 
different clones is denoted as B, K and i/, respectively. The number of cells making up a given clone is not 
constant in time, but may increase due to an antigenic stimulation addressed to the pertaining specificity (the 
Burnet clonal expansion ^25) ): in the following we call "activity" a logarithmic measure of the amplitude of a 
clone and we denote it by the set of variables fe^ {v E (1, B)), k^ {fi E (1, K)), and hi {i £ (1, H)), 
in such a way that the actual concentration of B cells, killers and helpers is ^ exp(fey), ^ cxp(fcp), ^ 
J2^exp{h,), respectively |,18 ] fT9 l l26]. 

Of course, different clones of the same branch can interact with each other (see e.g. |18l [TOl [271 E51 I^ V. 
these interactions, at least for B and Tk, play a role in the development of memory of previous antigens 
or in self /non-self discrimination and it is effectively accounted for by taking Gaussian distributions for 
their activity (as explained in Appendix A), yet, here we focus on the interactions mediated by cytokines 
which provide signals acting between CD4+ and B cells, as well as between CD4+ and CD8+ cells. Such 
interactions give rise to a tripartite network, where parties are made up of CD4+, B and CD8+ clones, 
respectively, and links are drawn whenever interleukins and/or interferons are exchanged among them (see 
Fig.0. 

Now, as anticipated, the activity of both effector branches (i.e. CD8+ and B cells), is assumed to be 
distributed around a given mean value, which, at equilibrium, must be very small denoting a typical low 
activity; in agreement with experimental findings [30] and with the arguments developed in Appendix A, we 
say that, at rest, (for any fi, v) k^ and b^, follow a Gaussian distribution A/'[0, 1], peaked at zero and with 
unitary standard deviation. On the other hand, CD4+ cells are described by dichotomic variables, that is 
hi = ±1, for any ^ positive values mean that the relevant clone is in an active state, namely high rate of 

^This assumption implicitly suggests that the time scale for helper reaction is slower than those of the branches; indeed in 
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cytokines production, viceversa —1 stands for quiescence. Anyhow, it is worth underlining that the picture 
we are going to offer does not depend qualitatively on the kind of distribution, either Gaussian or binary, 
chosen for the activitjj^ 

Finally, the state of cytokines acting between the i-th helper clone and the fi-th B or i^-th killer clone, 
is encoded by a dichotomic variable = ±1,^^^ = ±1; a positive (negative) value means that there is an 
excitatory (inhibitory) stimulation. Here we adopt a minimal assumption and we say that the probability 
distributions for ^ is given by P{ii.^/i, = 1) = P{£,i,ti/u — ^1) — Iii the following, the cytokine pattern 

{^ifi,S,iv\ is supposed to be quenched and, as we will see, such pattern encodes proper "strategies" learnt by 
the system during life and profitable to cope with possible antigenic stimulation]^ 

3.1 The statistical mechanics approach 

The following analysis addresses the functioning of the system considered, that is, we look at the conditions 
for the establishment of stable configurations and/or for the rearrangement of configurations following an 
external stimulation. 

In order to describe the system we introduce the "Hamiltonian" 

^ H,K ^ H,B 

'HH,B.K{h, k, b; ^) = — = ^i.f^Kk^ = ii^^hib^, (1) 

where the first term accounts for the interactions between clones of CD4+ and CD8+ populations, while the 
second term for the interactions between clones of CD4+ and B populations. Following statistical mechan- 
ics prescriptions, the Hamiltonian Hh, b. K{h, k,b; ^Y\is nothing but a cost function for the configuration 



{hiyk^^bi,}: The smaller its value and the more likely the correspondent configuration; in the jargon of 
disordered system, Eq. ([T]) represents a tripartite spin-glass. 

Since the statistical mechanics analysis will be performed in the infinite system size limit, i.e. in the limit 
of large H, B and K , we need to specify a meaningful scaling for their ratios by introducing the parameters 
a, 7 e R+ such that 

a = lim -— , 7 = lim -— . (2) 

H^oo H H^oo H 

The performance of the system described by Eq. ([T]) can then be studied following the standard routine 
used for disordered systems |32[ l35]. First of all, one calculates the partition function 



,B,K{h,b,k;£,)] , (3) 

{h} 1^=1 ^=1 



our perspective the latter act as inputs of information for helpers which then need further time to elaborate and readjust their 
state; this is also consistent with the fact that, due to the interplay of the subfamilies Tj{-^,T[j^, the time needed by helper 
cells to respond to a stimulation is relatively large (see for instance the discussion in 1311 ). Furthermore, if the timescale for 
helper cells was faster, their contribution to the potentials V{h) and V(k.), introduced in appendix A and ruling the activity of 
effector cells, would be zero since the integral over helper states is null. 

^Here we choose the latter for helpers as the discrete nature of h variables is consistent with integrate-and-fire models j32l. 
where the action of the agent considered (e.g. a neuron, a lymphocyte, etc.) is generated when the received input (e.g. a 
voltage, a cytokine concentration, etc.) reaches a threshold, as this will simplify the mathematical handling of our model later 
on. 

*The assumption of identically, symmetrically distributed cytokines can be possibly relaxed as done for instance by Amit 
|32l in the neural scenario to reflect more realistic biological features. 

^So far we assumed that learning is already achieved during ontogenesis and we focus only on the ability in retrieval of 
mature immune systems. However, the model we present, whose associative memory ability is obtained bridging it to an 
associative neural network, is a tripartite spin-glass that naturally describes a two-layered restricted Boltzmann machine as 
those commonly used to store information in Machine Learning 1331 1341 . 

®The system considered admits an Hamiltonian representation due to the assumed symmetry in couplings which ensures de- 
tailed balance, which, in turn, ensures the existence of canonical equilibrium. Surely a step forward would be the off-equilibrium 
analysis of the non-symmetrical version of the model, which may also allow a quantitative matching with experimental data. 
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where d^{x) represents the Gaussian measure on x, that is exp(— and /3 S is the degree of (white) 
noise in the network: Large values of /3 (small noise limit) make the Boltzmann weight exp(— /3H) more 
significant. From the partition function all the thermodynamic observables can be derived: for the generic 
continuous function 0{h, b, k) one has the so-called Boltzmann state u){0) as 

^^^^ = Z \bT) ^ / n '^^(^-) / n dv{K)0{h, b, k) exp [-mH,B,K{K b, k; 0] ■ (4) 

For our concerns, the main quantity of interest is the free-energy (or pressure), which here, in the infinite 
system size limit, can be evaluated as 



^„,^(/3)- lim ^Elog Zh,b,k{P;0, (5) 



where we also applied the average E over all the (quenched) values of in order to get an estimate 

on the typical realization of the cytokine network. 

Now, the minimization of the free energy with respect to proper order parameters (see appendix B) is the 
main path to follow in order to get the most likely states, as this contemporary entails energy minimization 
and entropy maximization; moreover, singularities in any derivative of the free-energy are signatures of phase 
transitions demarcating regions (in the a,/3,7 space) where the system may or may not work cooperatively 
(see e.g. |321). 

Before analyzing Aa^-y{fi), we need to compute explicitly the partition function Zh.b.k] by noticing that 
it does not involve two-body interactions within each _B, branch, but only one-body terms in b and k, we 
can directly carry out the relevant Gaussian integrals so to get Zh.b,k = ^{h} Gxp(— 'HHopfieid(/i; 0); being 
^Hopfioid the effective Hamiltonian 

„ H K B 

HHopficid(/i; 6 = -f E ( E ^re; + E ^^^j) ^^^^^ (6) 

'i<j /^— 1 u—l 

which, interestingly, recovers the Hopfield representation of a neural network (see next subsection) |32l I36| . 

Such equivalence states that a n-partite spin-glass and a sum of n — 1 independent neural networks display 
equivalent thermodynamic behaviors (same free-energy, phase diagram, collective properties, etc.). 
From an immunological perspective, we see that the behavior of a system where helpers promote/suppress, 
via cytokines, the two effector branches underlies an effective system where cytokines directly connect helper 
cells via an Hebbian interaction making them able to learn, store and retrieve patterns of branch activations: 
B and Tk branches work as sources of information (stimulative layers in the neuronal counterpart |33| ) 
for Tjj's, which, in turn, store such information trough effective pairwise interactions (similarly to the 
mechanisms applied by neurons |32j). 

Finally, we would like to emphasize that this model, although being a minimal one, is able to capture 
the crucial traits of the system: Qualitative differences in time-scales as well as the basic properties of 
interactions are accounted for, also showing that the description obtained is robust with respect to some 
technical details. Moreover, as we will show, the model displays several emerging properties, finely matching 
real systems. By the way, the same tripartite system proved to be a proper effective model also for explaining 
the emergence of Chronic Fatigue Syndrome |31| : In that case the focus was on the evolution of the synapse 
realized by CD4+ cells between CD8+ and B cells, and on the possibility to develop a Pavlovian associative 
learning of a prolonged infected status. 



3.2 On the mapping with the neural network 

As already underlined in the past (see e.g. |18l [?T1 [571 [551 [5^ HO]), there is a strong analogy between 
neural and immune systems: Both are able to learn from previous experiences and to exhibit features of 
associative memory as pattern recognition f l8| [521 [551 BT] . In the following we briefly sketch how neural 
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networks are formalized and how they do perform, also clarifying step by step the immunological counterpart 
within our model. 

Hopfield neural networks consist of interacting neurons described by the Hamiltonian (see e.g. |32 [ l42 j l43 ] ) 



where the states (ci = ±1) represent the two main levels of activity (i.e. firing/not-firing a spike) of 
the corresponding neuron, while the coupling Jij are the synaptic couplings between pairs of neurons (i, j). 
Moreover, one considers P "patterns" (denoted as {ff }/j=i,2,...,p)) which represent the embedded memorizable 
information and assumes that, as a result of a learning process, the synapses Jij({C}) bear values which ensure 
the dynamic stability of certain neuronal configurations {(7^}, corresponding to the memorized patterns; in 
this sense the network displays associative memory. In the standard theoretical analysis, the P patterns are 
usually taken quenchecj^ and random, with equal probabilities for = ±1. The specific form of storage 
prescription usually considered is given by the Hebbian learning rule 



and it is straightforward to see that, by plugging Eq. (|7| into Hni once having renamed P as B and K one 
recovers each of the terms in Eq. ([6|. 

Hence, in the immunological scenario, each CD4+ cell plays the role of a neuron, and its state {hi = ±1) 
represents the two main levels of activity (i.e. secreting/not-secreting a cytokine signal) for the corresponding 
specificity. The coupling Jij derives from the combination of the set of cytokines secreted by clones i and 
j, respectively: if these clones interact in the same way (^^ ~ ^'j ~ with the clone fc^ (6^) there is a 
positive contribute to the coupling Jij and vice versa. In this way the interaction between different kinds of 
lymphocytes is bypassed and allowed for by a direct interaction between CD4+ cells only, which effectively 
coordinate the effector responses. 

Let us now consider memory features: Patterns are said to be memorized when every network configu- 
ration tTi — for 1 = 1, N for every of the P patterns labeled by /i, corresponds to free-energy minima 
(i.e. stable to all single-state flips), also called attractors. In the immunological scenario patterns can still 
be thought of as the "background" of the system, that is, they encode successful "strategies" adopted by the 
system during previous diseases and infections and then properly stored for being retrieved in case of future 
attack by those antigens. Therefore, we define a "strategy" as a pattern of information that the helpers send 
(exchange) to a particular clone of a branch: If, for example, focusing only on B — T^f interactions, the 
system wants to tackle a response against an antigen and, say, both clones vi and V2 are able to bind to 
it, then helpers are expected to arrange in such a way that, according to the values of {C^^SC^Ii both b^^ 
and result to be excited, conversely, B cells which do not bind to the antigen are not involved as they 
receive suppressive signalf]^ Of course, the implicit assumption is that the antigen considered has already 
been dealt with and the strategy has been properly stored. 

We recall that the retrieval of a strategy is realized when the corresponding activity configuration for 
helper lymphocytes, i.e. {hi}, is stable in time, which means that CD4+ cells secrete and absorb cytokines in 
a collective fashion. Now, despite the fact that the J^ 's have been constructed to guarantee certain specified 
patterns to be attractors, namely fixed points of the dynamics, the non-linearity of the dynamical process 
induces additional non-global minima (linear combinations of pure states), referred to as spurious states 

^It is usually assumed that the performance of the network can be analyzed keeping the synaptic values fixed, or quenched. 
This implies that during a typical retrieval time the changes that may occur in synaptic values are negligible. 

^Within our framework, the need for suppression of non-involved clones is clear as they would contribute only raising the 
noise level, implying bad functioning and dangerous correlations. This is in agreement with the experimental finding that 
(leukemia or lymphocytosis apart which imply a pathological activation of the immune system) the amount of lymphocytes in 
the blood is roughly constant over time (ranging from 0(10^'^) to 0(10^''), that means on logarithmic average 13 it 1), which 
means that only a very small number of families is activated. 




P 




(7) 
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|32j : In neural networks such states are considered as erroneous retrieval of an attractor, because the system 
is meant to retrieve a given pattern of information at each time, while, in the immunological counterpart, 
their interpretation is rather different as their existence allows for broad, parallel immune responses. More 
precisely, spurious states realize the overlap of several strategies so that the immune response can address 
contemporary different kinds of antigen infections. For instance, if two antigens are contemporary present, 
each with high chemical affinity with, say, three different lymphocytes, the helpers would perform parallel 
six-strategies by sending the correct signals to the involved cells, eliciting the useful cells and suppressing 
the non-involved ones. Incidentally, we notice that Hopfield networks (as actually close to spin-glasses where 
the amount of minima scales exponentially with the volume) work much better as spurious state collectors 
than pure state retrievers. 

In order to quantify the ability of these models in working as associative networks, we consider a set 
of order parameters (see also next section), among which the B + K Mattis magnetizations m^,m}' which 
measure the overlap of the actual configuration of the helpers with the /i-th and v-th. pattern, that is 



both ranging in [—1, 1]. It is easy to see that if the configuration is correlated (uncorrelated) with a given 
pattern ^^v, the corresponding overlap is macroscopic (vanishes ^ 0{1/N)); of course, for full correlation 
the overlap is unity. 

By tuning the parameters of the system, i.e. the noise level (3 and the relative size of the branches with 
respect to H (namely a, 7), its ability to retrieve varies significantly. Starting from a high level of noise in a 
network with a fixed (relative) number of patters a -I- 7, there exists an ergodic phase and no retrieval can be 
accomplished {rn^^^ — 0); indeed, in the limit /3 ^ 0, any configuration is equally likely. By decreasing the 
noise level one crosses a "spin-glass" phas^ the noise level at which this happens is l3Q{a + 7). Below this 
line there is no retrieval (m = 0), yet the system is no longer fuU-ergodic. Now, if the number of patterns is 
larger than a certain critical value, i.e. (a + 7) > [ac(/3 = 00) +7c(/? = 00)] = 0.13^"^ the reduction of noise 
is useless for retrieval. While the existence of such a threshold in a is rather intuitive in neural networks 
(because if we try to store too many patterns, then the interference among them becomes large, making them 
ultimately unrecognizable) , here (a + 7) = {B + K) / H represents the relative ratio among the inner and 
the effector branches: As the amount of helpers decreases, the network falls off the retrieval region and the 
system is no longer able to display a collective performance; this situation closely resembles the transition 
from HIV infection to AIDS (we recall that the immunodeficiency virus kills CD4+ cells). Furthermore, 
we notice a nice consistency between the requirement of a low ratio between the effectors and the helpers 
expected for a healthy performing system and the fact that antigen recognition is actually spread over the 
whole lymphocyte network. In fact, the length of an antibody is L ^ 10^ epitopes; without recognition 
spreading (i.e. according to a single particle approach) the system would need 0{2^) — 0{2^'^^) different 
clones to manage antigen attacks. Conversely, the total amount of lymphocytes is estimated to be 0(10^'*), 
which implies the existence of inner interactions among the clones (see for instance [45j for experimental 
findings, [18J for theoretical ones). 

On the other hand, for 0.05 < a + 7 < 0.138, by further decreasing the level of noise, one eventually 
crosses a line /3j\/(a -I- 7) below which the system develops 2P meta-stable retrieval states, each with a 

'Spin-glasses are complex systems which, above a certain noise threshold (freezing temperature), are ergodic with spins 
randomly oriented (paramagnetic phase); at low noise, spin-glasses display a non-ergodic behavior characterized by an enormous 
amount of metastable configurations, due to the contradictory (frustrating) interactions preventing long range correlations 
between the orientations of the different spins. Hence, freezing takes place with the spins oriented at random with respect to 
each other; the magnetization upon freezing is therefore zero, just like in the paramagnetic state. Therefore, in order to evaluate 
spin-glass emergence, additional order parameters are necessary, often denoted with q, such that their average can discriminate 
between spin-glass freezing (g > 0) and paramagnetism (ij > 0), (see also next section). 

^"We recall that these values have been calculated for a fully-connected (FC) network, which means than each agent i 
is connected to any other agent j ^ i. Actually, real systems display a non-negligible degree of dilution, for this reason a 
quantitative comparison should be carried out only once the theory for diluted system will be accomplished, on which we plan 
to report soon. Here we just mention that values calculated for FC systems underestimate experimental measures and we know 
that, indeed, the introduction of dilution yields a rise in the critical values I44| . 
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macroscopic overlap (to ^ 0) with some strategy. Finally, when a + 7 < 0.05, a further transition occurs 
at /3c (a + 7), such that below this line the single-strategy retrieval states become absolute minima of the 
free-energy. 



4 Poly-clonal activation: formalization and outcomes 

The system we described via the Hamiltonian ([ij is actually always subjected to external stimuli (viruses, 
bacteria, tumoral cells) on the effector branches. As a response to this "work" made on the system, the mean 
activation of effectors may vary. Adiabatically (which is the correct limit as we are working in equilibrium 
statistical mechanics), this can be modeled by assuming drifted Gaussian distributions for the activity of B 
and CD8+ cells, that results in shifting their mean activity levels from zero to positive values 60 ^^nd /cq, 
respectively. As the theory is symmetric under the switch bi, O fc^, for the sake of simplicity (and with 
ALPS scenario in our mind) we can focus only on the CD8+ ensemble and we write 

P(k) oc exp ^ P(k) oc exp , (9) 

where we used the bold style to denote a vector. Notice that, for simplicity, we assumed that all clones feel a 
stimulus, regardless of their specificity and this corresponds to a mathematical representation of poly-clonal 
activation. As a consequence, the partition function ([3| turns out to be 

h •' V M 

By introducing the change of variables — {k^^ — ko), we can solve the Gaussian integral and notice that 
this maps our original system into one described by the following Hamiltonian 

„ H K B H 

PH(h- $) = I E ( E ^'^3 + E ^^"^0 ^^^^ + E (11) 

where $ = -^7^0 is a properly rescaled measure of the mean activity, and Xi — ^ random 

field, which in the infinite system size limit converges to a standard Gaussian N[Q, 1]. From a statistical 
mechanics point of view we know that the system with shifted Gaussians for the set of variables k^ can be 
recast into the previous one plus an external random field acting on the clones hi and whose strength is set 
by fcoi namely the width of Tk clonal expansion; otherwise stated, the stimulation of an effector branch acts 
as a perturbation on helper activities. 

Actually, it is easy to see that a random field also emerges in the presence of a monoclonal activation, 
elicited by a given antigen, and, in general, it is able to yield a small activation of arbitrary clones, possible 
against self. This picture provided by our model is in agreement with the existence of low-titer self-antibodies 
also in hosts not affected by autoimmune diseases. Indeed, the concentration of such byproduct antibodies 
allows to determine a reference threshold to discriminate between low and significant activation. 

There is another deep implication in the transformation % ^ %, induced by the stimulation: A non- 
negligible activation of B or CD8+ lymphocytes (i.e. 69 and/or fco 7^ 0) necessarily generates some sort of 
disorder (i.e. x) within the system. Indeed, on the one hand we have an organized immune response due 
to effector activation, on the other hand we have an disorganized immune response due to the emergence of 
a random perturbation on helper branch. Interestingly, this encodes a basic thermodynamical prescription 
(close to the second principle) in the framework of theoretical immunology: an ordered work can not be 
accomplished without introducing some sort of disorder inside the system and, the larger the former the 
higher the level of noise introduced (note that the Hopfield network "naturally" represents the internal energy 
contribution) . 
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It is worth remarking that, consistently with this thermodynamical picture, in physics the energy is 
coupled with time t and, typically, ordered energy flows linearly with time (~ t), while heat (disordered 



energy) diffuses (~ v^) . In complete analogy, by looking at eq. ( 1 1 1 , we notice that the internal energy is 
coupled to /?, while the heat source with ^/]3. 

Finally, we stress that the same formalism still holds for lymphocyte suppression, where activation is 
shifted towards negative values, again yielding the emergence of a random field which deranges the immune 
performance. Indeed, too low levels of activity of effector cells would yield to a lack of communication 
among them with consequent falling off of systemic regulation; otherwise stated a non-null activation level 
is necessary to maintain a network, that is to encode information |46| , 147 } l48]. 

4.1 The statistical mechanics analysis of autoimmunity 

In this section we want to investigate how too strong an activity fco 3> (lymphocytosis) can possibly 
determine pathological degenerations in the system under consideration (autoimmunity). As we are going 
to show, if the activation ko is too massive, the random-field term in Eq. ( |IT| ) prevails against the Hopfield 
interaction term (responsible for strategy retrieval) such that the system behaves essentially randomly, 
inducing wrong signalling among CD4+ cells and other lymphocytes, and consequently auto-immunity. In 
general, the ability of the system to retrieve stored patterns depends on the parameter set (/?, a -I- 7, $): The 
mutual balance between such quantities determines whether, in the presence of a stimulation, the system 
succeeds in properly cope with it according to what learned in the past. 

The statistical mechanics solution of the model is rather technical and details are left to Appendix B, 
while here we sketch the main results. At first, in order to get familiar with the model, we consider a very 
simple situation where the antigen is detected only by, say, lymphocyte 61, so that we simply focus on the 
retrieval of the first pure state, that is we look at the regions, in the (a,/3, $) space, where only one generic 
Mattis magnetization, i.e. mi = m, may increase (for suitably initial conditions), while all the others remain 
zero. Beyond m, another parameter which turns out to be useful is q = E(1/7V) J2i=i '^{hiY, which measures 
the spin-glass weight [32J. Exploiting replica trick techniques [35JI15], the free energy of the system is found 
to be 

/(a,/3,7,*;m,g) = + "^-^[l + /3r(l - g)] + ^/^^m^ + (12) 



\{j dKv) J dA^(z)log2cosh (/3m-t-^^^i^z+y^$77))5, 



where we fixed = "1(1, 0, 0, 0). 

Extremizing again the replica symmetric free energy f{a, /?, 7, $; m, q) with respect to m, q, we can find the 
self-consistent relations 

m = M(a,/?,7,$;m,q) = J dti{7j) J dAi(^) tanh^^ (/3m + ^^^^^^ll^^ + (I3) 

q = Q{a, /3, 7, ^;m,q) = {J dfiirj) J dfi{z) tanh^ (/3m + ^^^^^^ + V^'^'?) )« (W) 

Now, for a given set of parameters a,/3,7,$, the values of such observables allow to understand whether 
the retrieval can be successful, thus we solve numerically (details can be found in appendix C) Eqs. (13-14). 
In general, we find that V/3 > 1 and $ > 0, there always exists a solution with m — and q > 0, which 
corresponds to a spin-glass phase. Beyond such a solution, a pure state solution (m > 0) appears below 
a critical noise /3m (o; -I- 7,5') and in order to discriminate which is the more stable solution (between the 
pure state and the spin glass), we compared the relative free-energies to look for the lowest, finding that at 
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Figure 2: Phase diagrams: the dashed line represents the critical line /3m, which distinguishes among 
retrieval (in general sense) and spin glass phases, while the continuous line represents the critical line f3c, 
which confines the pure state phase. Upper panel: $ = (left) and $ — 0.5 (right); Lower panel: $ = 1 
(left) and $ = 1.5 (right). 

relatively large noise the pure state is not stable, that is it is only a local minimum; by further decreasing 
the noise /3, the pure state becomes a global minimum. 

Hence, similarly to what happens in the traditional Hopfield model (fco = 0), the amplitude of the pure 
state appears in a discontinuous way as far as the noise is lowered below a certain point, which defines a 
critical line /3m (a + 7, $), but only when the noise is further lowered below a certain point, that defines a 
second critical line l3c{oi+'-f, $) the pure state become the lowest free energy state that is, a global minimum. 
Results are summarized in the phase diagrams of Fig. 2. 

We recall that, in our framework, the pure retrieval phase represents the exposition of immune system to 
a particular antigen (only one particular activation pattern is retrieved) and summarizes the simplest case. 
Beyond this, one can also consider spurious states: For instance, a "spurious state" with three strategies of 
activation will be described by three Mattis magnetizations nii ^ 0, m2 ^ 0, 7713 7^ 0, while the remaining 

are vanishing, that is 0{y/H ) at finite volume (and zero in the infinite system size limit). Spurious (or 
mixed) states represent the ability of the system to follow multiple paths of cytokines activations at the same 
time, interestingly turning the large spurious land of these associative models as the main interesting part 
in this context. Of course, one could solve numerically the set of self-consistency equations for ampUtude of 
mixture states under whatever ansatz, calculations are just more complex and lengthy and we plan to report 
soon on this investigation. 
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4.2 ALPS, HIV and Ageing 



The schematic representation of Fig. 3 shows that there are basically three ways to escape from the perform- 
ing region: By increasing the extent of activation $ (toward a Random Field Phase), by breaking the balance 
of the ratios among different lymphocytes S/ThjTk/Th (toward a Spin Glass Phase), or by increasing the 
level of noise /3 (toward a Paramagnetic Phase). Interestingly, all these scenarios can be easily related to 
well-known conditions: 

• Example of the random field escape: Lymphocytosis. 

Autoimmune lymphoproliferative syndrome (or similar variants, see e.g. |50l I51| ) arises in people who 
inherit mutations in genes that mediate T-lymphocyte apoptosis, which is fundamental for the immune 
homeostasis (a healthy steady state for the host) , by limiting lymphocyte accumulation and minimizing 
reactions against self-antigens. As a result of inefficient apoptosis, lymphocytes grow monotonically in 
time and already in childhood severe autoimmune phenomena appear |12] . 

Such phenomenology emerges consistently within our model: In the presence of a large activation of 
lymphocytes, the random field phase prevails against the retrieval one; intuitively, the broad range 
of active killer lymphocytes makes helper cells to secrete arbitrary amounts of cytokines, ultimately 
loosing any capability of synergy. 

• Example of the spin-glass escape: Chronic Infection. 

An imbalance between the relative sizes of the subpopulations determines an increase of the parameters 
a, 7 and this may yield the system far from the retrieval region. Note, however, that the system now 
degenerates into a spin glass, a different scenario with respect to the previous case (random field) . These 
different zones in statistical mechanics correspond, in fact, to different immunological complications: 
While the former corresponds to an autoimmune manifestation, the latter is close to the well known 
transition from simple HIV infection to the overt AIDS disease. In fact, HIV infects and kills helpers 
decreasing monotonically in time the amount of these cells and consequently increasing the a, 7 values. 
A similar effect occurs in the presence of EBV infection since it somehow immortalizes B cells, with 
consequent anomalous increase of a. We stress that, although in both cases the net effect is a spin- 
glass escape from the retrieval region, the causes are completely different. The whole picture gives a 
rationale for the understanding of the CD4+/CD8+ ratio inversion phenomenoiFM 




• Example of the paramagnetic escape: Ageing. 

In our framework the causes of ageing can be free-radicals, by products, molecular cross- linking, damage 
accumulation and so on, which may preclude a firm binding between molecules and/or a slowdown in 
recognition processes |531 154| . Even though we have only heuristic arguments, this kind of aging can 
be bridged with the "real" aging of the living host. It is also interesting to notice that a smaller value of 
P (larger disorder) makes the critical level for $ smaller, consistently with the well-known correlations 
found in ALPS patients, that is, the risk of neoplastic complications grows with patient's age |12| . 

5 Outlook 

In this work we introduced and analyzed a model to describe the mutual interactions occurring among 
lymphocytes via cytokine exchanges. While the activity of helper cells is described by a dichotomic variable 
hi = ±1 (where i denotes the specificity of the clone), the activity, or clonal extent, of B and killer cells is 
described by continuous, Gaussian-distributed variables denoted as 6^ and k^, respectively: This choice is 
a result of a relaxation of an opportune Ornstein-Uhlembeck process where the interactions among agents 
belonging to the same branch {B — B, and Tk — Tk) create a quadratic self-interaction term in a mean-field 
approximation which implies Gaussian distribution in their equilibrium values. Interestingly, this result 

Notice that diluting the network towards more reaUstic descriptions Oc approaches 1 [52j in agreement with the experimental 
findings [l]. 
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Spin-Glass 
Chronic Infection 

Figure 3: Schematic representation of the retrieval region. The three normal ways for escape have been 
depicted: Random Field (too large or too low mean activity), Spin-Glass (too large relative number of 
patterns) and Paramagnetic (too large degree of noise). Such states correspond to unhealthy situations, 
namely lymphocytosis, chronic infections and senescence, respectively. Notice that in this plot the quantity 
a + 7 has been renamed a, consistently with the appendices, and that, the retrievial region is restricted, by 
definition, to the quadrant a > 0, /3 > 0. 



allows to bypass a direct estimate of the number of cells which means we can avoid dealing with chemical 
potentials and grand-canonical environments; in fact, we can let the clonal activity vary still retaining a 
canonical framework by considering not the cells, but the clones as quasi-particles. As for cytokine, the 
inhibitory /excitatory function of messages they carry from helper i on the effector clone /j. is encoded by 

— —1/ -I- 1. The whole ensemble is then formalized by a tripartite spin-glass system where CD4+ cells 
can interact with the so called effector branches, i.e. CD8+ cells and B lymphocytes via these exchanges. 

Firstly, we showed that such a system is equivalent to a neural network where stored patterns correspond 
to strategies to fight against antigens and are possibly memorized during previous infections. More precisely, 
cytokines patterns work as synapses providing Hebbian-like interactions among helpers: Helpers effectively 
behave as an associative neural network able to store and retrieve specific strategies in cytokine secretions 
for effector regulations. 

Then, we have mimicked the occurrence of a (poly-clonal) activation of the branches by shifting the 
Gaussian distribution of these effector lymphocytes to a non null value: We proved that a state of clonal 
expansion (lymphocytosis) or, similarly, of clonal suppression (immunodeficiency), is formally equivalent to 
a random field acting on helper cells; obviously, if the strength of such a field prevails against the normal 
interactions, the immune system would not work correctly, possibly giving rise to autoimmune diseases. 
Such a mapping also reveals a kind of immunological version of the second principle of thermodynamics: 
An ordered work (clonal expansion/suppression) can not be accomplished without introducing some sort of 
disorder, here random fields, inside the system itself (possibly giving rise to low-titer self-antibodies). 

We also performed an analytical study of the model via the replica trick obtaining (at the replica symmet- 
ric level) a set of self-consistent equations for the order parameters as functions of the parameters /3 (degree of 
noise), a (repertoire width ratio) and $ (clonal expansion extent). The numerical solution of these equations 
allows to build up a phase diagram for the performance of the system; in particular, we found that there 
is a region in the space (/3, a,$), where helper lymphocytes can correctly work as an associative network. 
The system may escape from this healthy state in three ways: Unbalancing the amount of the relative sizes 
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of the lymphocytes (e.g. HIV and EBV infections where the formula CD4+/CD8+ is reversed), performing 
too strong a response, namely a lymphocytosis (e.g. ALPS) or simply increasing the level of white noise 
(e.g. ageing of the system). The correlation between lymphocytosis and autoimmunity, or between ageing 
and autoimmunity, which still lacks a complete justification, at least in terms of statistical mechanics, finds 
here a clear explanation. 

Furthermore, from these results we can also observe that a performing immune system is a system able 
to spread information over the network of cells: In fact, as a can not exceed a threshold, the system must 
be able to respond to a large number of different antigens with the smallest possible repertoire, which is in 
agreement with every systemic observation on the immune network |5]. A performing system must disentangle 
in multiple pattern recognitions via spurious states, minimizing in this way the amount of required antigenic 
information for binding, in agreement with the experimental findings [281 1451 [55] . Along this line we notice 
that such network can be established only in the presence of some intrinsic activity: If /cq or 6o is too low, 
no connection among lymphocytes can be established and no information can be spread [461 ITfl H5] . 

A considerable amount of research is clearly opened: First of all, one could investigate about the lack of 
symmetry in the interaction matrix because, so far, we assumed that the signal sent by a given helper to, 
say, a given killer is the same as the other way round. Despite in physics (especially in equilibrium statis- 
tical mechanics) this symmetry (the third law of dynamics) ensures convergence to the Maxwell-Boltzmann 
equilibrium, in biology this property does not hold straightforwardly. However, once related the capacity 
of the network with the ratios among different types of lymphocytes, and properly introduced the clonal 
expansion, the whole approach a la Gardner [55J for unbalanced neural networks applies and could bring us 
closer to the quantitative world. 
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Appendix A: The hidden role of interactions in the Gaussian activi- 
ties 

In this appendix we provide an explanation about the Gaussian activity assumption we made for the effec- 
tor branches B,Tk', our arguments are based on the idea that their activity is also regulated by intrinsic 
interactions within each branch, which can be looked at in terms of an interaction network connecting B 
cells and Tk cells, respectively. Indeed, it has been evidenced that both cells exhibit, even in the absence of 
antigenic stimulation, a non-null activity which allows the maintenance of a network of mutual regulation 
even in rest conditions [461 WR H5] . From a mathematical point of view, an analogous behavior for B and 
Tk cells is intrinsic in our model due to the symmetry under the change B o Tk- 

We summarize the underlying mechanisms focusing only on B cells. Now, B lymphocytes secrete antibod- 
ies, which, given the huge amount of different clones, may detect antibodies secreted by other lymphocytes: 
Via this mechanism, antibodies not only detect antigens, but also function as individual internal images of 
certain antigens and are themselves being detected and acted upon. In this way an interaction network for 
B cells is formed and it provides the immune system with a "dynamical memory", by keeping the concen- 
trations of antibodies and of lymphocytes at appropriate levels. 

This part of theoretical immunology (early experimentally investigated in [281 H5l [55], then formalized in 
[2^1571155] and within a statistical mechanics framework in |18l [TO] can be intuitively understood as follows: 
At a given time an antigen is introduced in the body and starts replication; let us consider, for simplicity, 
a virus as a string of information (i.e. 1001001). At high enough concentration, the antigen is detected by 
the proper B-lymphocyte counterpart (producing the antibody Igl, which can be thought of as the string 
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0110110), which then starts a clonal expansion and will release high levels of Igl. As a consequence, after a 
while, other B-cells with a consistent anticorpal affinity with Igl (say 1001011, 1001000) will meet it and, as 
this string never (macroscopically) existed before, attack it by releasing the complementary string 1001000 
and 1001011, that, actually, are spurious copies (internal images) of the original virus but with no DNA or 
RNA charge inside: The interplay among such antibody concentrations keeps memory of the past infection 
and allows a network of mutually interacting lymphocytes whose topological properties have also been shown 
to be able to explain basic phenomena such as self/non-self recognition and low-dose tolerance |18IIT5] . An- 
other issue following this point is that, while B cells of the same clone do not interact among themselves, B 
cells belonging to different clones (provided that their anticorpal matching is strong enough) tend to imitate 
reciprocally: if the first clone undergoes clonal expansion, the clone corresponding to the anti-antibody will 
follow it, and viceversa. 

Let us now build a dynamical system where B cells and killers interact with each others in this way (i.e. 
ferromagnetically) and with helpers via cytokine exchange as well: the evolution of their activity then follows 
an Ornstein-Uhlenbeck process [59] like 



-^--)?Y. Jiik, -^Y. ^^h. - V^e), (16) 



1 = 1 V i=l 



where r represents the typical time-scale for the B-cells and killers diffusion (for simplicity is taken the same 
for both kinds of lymphocytes), J is the coupling among cells themselves, hi is the activity of the i-th helper, 
is the cytokine message between the effector agent /i and the helper i, while rj accounts for a standard 



white noise. Equations [15| and 16 state that the rate of change for the ly-th clone belonging to B (Tk) cells 
population is proportional to the stimulation provided by other B (Tk) cells via antibody exchange (via 
direct contact through T cell receptors) and by Th cells via cytokines exchange, in the presence of white 
noise. 

Given the ferromagnetic (imitative) nature of the interactions among analogous cells (if present), i.e. J^^, > 
V/i, v, we can properly rescale the parameters by the mean interaction (J) and, under a mean-field as- 
sumption J2fi JiJv-^u / {{J) B) =b^, we can rewrite the process as 

r''^^=~K-P'j2i'ih,-^ri^^\ (17) 



dt 

dk,, 
dt 



1=1 

H 



'k,-p'Y,^>lK~^/^,i^\ (18) 



i=l 



where t'(J) — r, 13' {J)\/H — (3 and t"{J)^ — t. The right-hand-sides of Eqs. 17 — 18 can be looked at as 
the forces eliciting the dynamic process, hence the related potentials read as (using the bold symbol to mean 
a vector) 

V(h)^-J2bl/2-l3j2^-hX, (19) 
Vik)^-J2kl/2-f3j2^^h,k^. (20) 

In this way, if we assume a Gaussian distribution M[0, 1] for the activity of B and Tk cells, the overall system 
can be described by means of the Hamiltonian H = —{^/"/H)^^^£^^hih,j — {^/Vh)^,^ ^^^hik/^^, exactly 
the one introduced in our approach (see Eq. 1). 

Therefore, the network approach developed in the last decades and based on the mutual interaction among 
B lymphocytes and the tripartite system approach introduced here turn out to be in perfect agreement: in 
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particular, within our merging the two possible mechanisms for the implementation of memory (long-Hved 
cells or clone-clone activation in a network la Jerne) can be regarded no longer as competing but rather as 
synergic. 

We stress that, at this stage, the detailed form of the antibody matrix J^,^ does not matter (see e.g. [IS] 
for details), the key ingredient being only its positive definiteness (given by the imitative nature of B and 
Tk cells), to ensure its mean value (J) to exist strictly positive. If interactions among B lymphocytes and 
among T lymphocytes were both inhibitory and excitatory, i.e. J is non-positive-definte like in spin-glass 
systems, then convergence would not hold in general and we would not be able to merge the two approaches. 



Appendix B: The replica trick calculation for the evaluation of the 
free energy 

The system, whose thermodynamics we want to tackle, is ruled by the following Hamiltoniaif^ (see Eq. Ill: 



a H K B H 

i<j fj. v i 

where Xi = ^T^S^Cfj ™ the infinite system size limit, converges to a standard Gaussian A/'[0, 1] via a 
standard CLT argumenip^ 

In order to study the retrieval phase of this system trough disordered statistical mechanics, we apply the 
so-called replica trick technique [60j (under the assumption of replica symmetry) following the derivation of 
Coolen, Kuhn and SoUich |3S]: The idea is to force the retrieval toward a particular ensemble of patterns 
I < B + K mimicking a reasonable dynamics toward one of the attractors which, indeed, can be identified 
by these I patterns; then, one needs to check where, in the region of the space [{a -|- 7), /3, $], suitably order 
parameters (the Mattis magnetizations that we introduce later) are stable and, further, where these minima 
are even absolute minima of the free energy, such that we have "thermodynamical stability'!^ Of course all 
the "not-recalled" patterns P — I now act as a quenched noise on the retrieval of the selected I patterns and 
we know how to deal with these remaining ^-terms. 

Before proceeding we notice that there is permutational invariance: thinking at the first I as the retrieved 
patterns is completely fictitious as any set of I patterns can work finely as well. As a consequence, we 
introduce a new symbol P = B + K because, as far as no differentiation among the subclasses Hi,H2 is 
made, the two effector branches are indistinguishable and only their total amount versus the amount of the 
available helpers matters. 



We now properly elaborate the Hamiltonian (21 ) by adding a finite number I of Lagrange multipliers 
to the Hamiltonian so to easily express Mattis order parameters to^ = ^f^i^ihi/H as derivatives of the 
free energy w.r.t. them; more precisely, one has 

I H 

n{h; n(h- + /3 E E ^r/i- 

/J — 1 i 



^^Strictly speaking, in standard statistical mechanics, the noise level plays a uniform role on the interactions, while we face 
with its linear coupling to the Hopfield terms and a square root one to the random field term. The need of a uniform influence 
is of course nor a biological must neither a mathematical restriction and can then be easily relaxed. 

^^Two correlated observations are needed here. First the approximation to a Gaussian may appear dangerous because for 
the same CLT argument the Hebbian kernel converges to a 1], too; this actually onsets the transition from an associative 
behavior to a spin glass phase. However, while the Hebbian kernel in this procedure loses its peculiar organization of the phase 
space able to store and retrieve information, 77 is a random object even without the CTL limit and its convergence to a standard 
Gaussian only simplifies calculations. 

'^^We will find even a large region where only spin glass states exist and a large mixed region where these minima exist but 
are local minima, the spin glass being still the global one; the latter is the "spurious states" scenario, where, despite these are 
not thermodynamically stable, are still of primary interest in the dynamics as are however well defined attractors with long 
meta-stable lifetimes 1321 . 
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from which, recaUing A{a,P,j) — —PFlajfS,^), one gets 



A=0 



Basically, the role of multipliers is to force to end up in the selected attractors. One has three different 
kinds of noise which are not part of attractors: /3, the RF and the excluded patterns B + K — I. Hence, the 
complete Hamiltonian which we study is 

„ H K B H I H 

- m{h; A) = I ere; + E ere;)/^./*. + ^/Pi^o E v^h^ - /S E E '^^^f ■ (22) 

We want to solve the thermodynamics (i.e. obtain an explicit expression for the free energy and a picture of 
the phase diagram by its extremization) via the replica trick, which consists in evaluating the logarithm of 
the partition function trough its power expansion, namely 

logZ = lim (logZ) ^ lim ^ = lim -log(Z"). (23) 

n-i-O n n-i-0 n ri-i-O n 

This implies that in order to obtain the mean of log Z one can average Z", which is itself a partition function 
of n identical systems which, for any given set of random variables, do not interact: these are the "replicas". 
The intensive, i.e. divided by H, free energy reads off as 



^ = lim log E exp(-/3EH(/i^0), (24) 



where we introduced the symbol a G (1, n) to label the n different replicas of the system (with the same 

quenched distribution of the ^). 

By plugging Eq. |22] into Eq. |24] we get 

(F) « + 7 log2 ^ I n H . H 

^ a 

H n ^ n P H 



i a a ^yl i 

where we can linearize the quadratic exponential terms for the fi < I with the Gaussian integral, and apply 
for convenience the shift — > \/l3Hmafi, as 

(^(E^^^n') = /^JdM(^a,)exp (^^E/z^C'^.m) • 



(26) 



The intensive free energy can be written now as 

{F) _ a + 7 _ log2 _ 
H ^ 2 /3 

nl I n H 



^^obL^^^^'^' I n^-".^--^-"-(-p(/3EEE'^^^rK-^.]) 

^ n P H n H 

(«^p E E(E ^r/^")' + v^«o E E ^^'^O )«^")''" • 



a /j,>/ i 
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Wc note that, as B and K act together as identical interacting terms, among the I retrieved patterns we do 
not distinguish between those from the B components and the K ones; it is then useful to "diagonalize the 
perspective" by introducing the variable P as follows: 

We have a global amount of B + K ^ P clones. In this set, I are retrieved, P — I are the remaining 
terms. Among these, P — I — P can be though of as the responsible for the (not retrieved) interactions 
with the B (in the corresponding 3-parties spin glass) and P are left for the interactions with the K (in 
a nutshell it is a reshuffling). We can then average over the quenched noise and linearize even the term 

(exp J2l E^>;(E,^ ^ihtf)}i so to write the free energy as 



(F) ^ a + 7 _ log2 _ / pH 
H ~ 2 /3 pHn V 27r 



n.l 



(exp (V^E E ^^^f « - V)) exp (//(a + 7) log 



a a, 13 



H.i 



where the term 1 has been introduced symbolically into the expression so to be rewritten as 



Now we assume the commutation of the limits lim„^0)limH^^oo and get 
a + 7 log 2 



)] (29) 



- jtoo / n dma, I n ^9-/5 / n ^qc? 

^ •'an al3 a/3 

1 /' ' 

• exp H(i^ ga/3?a/3 " 3 ^ E "^"M + + 7) log / JJ dfJ,{Za) 

n H H H n 

■ (exp E E E ^i^i^^a - - i E E ^^^i + v^«o E E ^^'^i ] )'^»- 

//<? a ? a/3 z i a 

The n-dimensional Gaussian integral over z factorizes in a standard way after appropriate rotation of the 
integration variable as 



log / dii{za) exp {^^ ^ ZaQccpZf^ = logdetp ■ 

ap 



(30) 



which allows to rewrite the free energy as 



H H 



(a + 7) _ log 2 



n^o H ^00 pHn J J J 



■ exp {[H{iJ2Qafiqa0 - ^Pj^^^a^^^) logdetp - /3Q])]) 

a/3 ajLi 

H n n 

■ n(e^p(/^EE^"^n"^M-^A.)-»E^"9"/3'^'' + v^«o^E'^"])^''''' (^^^ 

i (U<i o a/3 a 

where Ej^^ represents the average over the quenched variables ^, rj As we reached a formulation where all the 
exponents are extensive in the volume H, we are allowed to apply the saddle point method such that the 
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extremal {f{m,q,q))3 : \imH^a{F)^H ^ = lining q \im h ^ oc { f {m, q, q)) , being 

n 

"(log(exp(/3^^;i,^^(m;;-A^) 



2 p n^o [in 



exp - i ^ h°'qaph^ + \^Kori ^ /i" 

q/3 a 



1 



1 



+ i'^qapQap- ^I3^ml^- -{a + -/)\ogdet 



(32) 
(33) 



q/3 afi 

Let us study the behavior of the rephca-symmetric matrix 

Aa0 = [1 - /3(1 - g)]5a^ - m, 

where the matrix Q has all the off diagonal entries equal to q and the diagonal ones to 1. There exist two 
eigenvectors, namely x = (1, 1, 1) with algebraic multiplicity 1 and eigenvalue Ai — 1 — /3{l — q) — Pqn, and 
X = J2a ^a. = 0, namely the whole hyperspace orthogonal to the first eigenvector. Of course the algebraic 
multiplicity of the latter is n — 1 and its eigenvalue Aj = 1 — /3(1 — q). So we can write the determinant of 
the matrix A as the product of all its eigenvalues to get 

logdetA = logJjA, = log[l -/?(!- g)-/3gn] + (n ~l)log[l-/3(l -q)] 



.[log[l-/3(l-g)]-^-^ 



+ 0(n2), 



(34) 



as we are expanding around small n because we are approaching the n — >■ limit. 
Overall we can rewrite the free energy as 



f{m,q,r) 



log 2 a + 7 

a + -f 



log 1-/3(1 -g) - 



f3q 



1-/3(1-9) 



(35) 



^E,(log(exp ([^(^ h-){Y^ m,e) + ^(« + i)PMY1 + ^'^o^(E 

a /i</ a a 



Now, focusing on the last line of the expression above we can linearize the quadratic term (X)q h"')'^ through 
a standard Gaussian integral representation, 

exp(-i(« + 7)/3r(E/i'^)2) = J dfi{z)exp (/3 V(« + 7)r;^(E /»")) , 



and get (writing once again only the last line of expression (35l) 

-^E^(log(d/i(z) exp [( E h'^) (/3(E m,,^n + p^ia + j)rz + ./^Kov)])h)i 

^E,(log J dA*(z)2"cosh" (/3((Em^e^) + ^ (a + ^)rz) + Vp^^ov))i 



(36) 
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Now, using cosh"(x) ^ 1 + 7ilogcosh(a;) and writing the whole free energy we get 

/3q 



a + 7 



(37) 



2/3 



log[l - ^(1 - q)] - 



dfi{ri) / d^(z)log2cosh iSi^i^rrif,^^) + y^{a + j)rzj + y^Korj 



Extremizing again the rephca symmetric free energy we can find the self-consistent relations 

TO = ( y d^{ri) J dfi{z) tanh f /3(y^ "VC^ + \/ {a + l)rz) + y/Jhnprj])^, 

fj.<i 

1 = ij Mv) J dfi{z) tanh^ to^^'' + Vic^ + J^z) + \//37«o??) > 

r = q/(l-f3{l-qfy 



tj.<l 



(38) 

(39) 
(40) 



These equations must be solved numerically (the difficulty in the involved mathematics mirrors the sudden 
jumps in the order parameters values), to which the next section is dedicated. 

Appendix C: Numerical solutions of the self-consistency equations 



As shown in Eq. (Ill, both the ratio a + 7 between killers and helpers and the strength of the killer clonal 
expansion fco multiply the random field at once: We use $ = y/j^o as a single tunable parameter and we 
stress once more that, analogously to P and P in the previous appendix, only the total amount of branch 
lymphocytes matter in the ratio with the helpers (namely {B + K)/H), so we shift a + 7 a for the sake 
of simplicity. 

In analogy with the standard Hopfield model, the phases where our system may show emergent cooperative 
behavior among its constituents are several and here we outline our strategy to detect the two (limiting) 
simpler cases. As for the pure states, we look at the regions, in the (a, (3, $) space, where only one generic 
Mattis magnetization, say toi — to, may increase (for suitably initial condition), while all the others remain 
zero; further, with the overlap qa/s we can measure the spin glass weight; in fact, for high noise level (/3 < 1), 
m — q ~ and the system is ergodic (of no interest in theoretical immunology), while focusing on the 
low noise level (/? > 1), we can distinguish a spin-glass phase with to = 0, q > and a phase where the 
system displays associative memory with to > 0, q > 0. Beyond this extremum case, there is a whole 
family of other cases where spurious states appear. For instance, a "spurious state" with two patterns 
of activation will be described by two Mattis magnetizations toi 7^ 0, TO2 0, while the remaining are 
vanishing, that is 0{yfH ) at finite volume. Of course, increasing the number of antigens means increasing 
the B, K repertoires, which lastly falls off the system toward a spin glass phas^^ This other extremum (the 
maximum amount of parallel paths of activations before collapsing into the spin-glass region) is the second 
case we analyze. Here we study the RS spin-glass and RS pure state solutions numerically: We insert the 
pure state ansatz = to(1, 0, 0) in the self-consistency RS equation system ( 38|39|40 l, then we eliminate 
the equation for r substituting it in the formers, so to obtain a new set of equations for to, q and the free 



Physically the transition to a spin-glass state is accomplished with an exponential increasing of the minima of the free 
energy which pushes the network into the "blackout scenario" 32 . This can be understood intuitively as the amount of 
spurious states, namely linear combination of pure states (with smaller basins of attractions) grow as the Newton binomial, i.e. 
in a non polynomial way. 
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Figure 4: From left to right: Solutions of the RS self-consistency equations for ($ — 0.5, a + 7 = 0.01). Red 
line: solution of to — M{m, q,a + j, $, f3) = 0, Blue line: solution of q — Q{m, q,a + -f, $, (3) = 0. 

(a) 1//3 = 0.8. Only the upper branch counts, under the value q = 1 — 1//3 the free energy has only complex 
values. 

(b) 1/13 — 0.6. In this particular point a-l-7, $, f3~^ a pure state solution to > appears as the two contour- 
plot lines -for to and for q- are tangent. 

(c) 1//3 — 0.5. Solution of the RS self-consistency equations for ($ = 0.5, a + 7 = 0.01). Free energy is 
complex along the lower branches which are therefore rejected (note that they never cross in fact). Above 
two intersections appear. Only the higher to, q intersection is the thermodynamical pure state solution 
because it is coupled with the lower free energy. 

(d) 1/ f3 = T = 0.2. Note that lowering the noise, (for a -I- 7 < (a -I- 7)c = 0.138) we always find the pure 
state retrieval solution. 



energy (37 1 



TO 



M(to, g; /3, a + 7, $) = (y dfi{v) J dfi{z) tanh (/3to + ^^^^^^^ + 7^*^) (41) 
Q{m,q;f3,a + j,^)^{J dfi{T^) J dy.{z) tanh^ [fim + {"i^^^^^^qf + V^^^))^ (42) 



firn,q,r) 



Pq 



a -I- 7 



2^ ■■ A' 



(43) 



log[l ~ /3(1 - g)] - - 



P{l~q) 



^{JdKv) I dM(^)log2cosh (/3TO+^^^^z+v^$r?))^ 



We have used the software Wolfram Mathematica 7.0 to compute numerical solutions of eqs. ( 41|42 1 and 
calculate the free energy (43 1 of these solutions: To speed up the evaluation, we noticed that the integrand 



of the RS self-consistency equations is a product of a hyperbolic tangent and two Gaussians. The hyperbolic 
tangent is always bounded by one and the Gaussians go quickly to zero. As we have fixed the precision of 
the integration in the software, and therefore the zero, to 10"^", we decided to fix the extreme of the z and 
7/ integration to —5 and 5 as e~^^ ^ 10~^^. 

In Figure [5] the solutions of to — M(to, g, 1//3, a, $) = and q — Q(to, q, 1//3, a, <&) — for fixed a — 0.01 
and $ = 0.5 at decreasing noise level are shown: Above a certain level of noise the two lines representing 
the solutions in the plane (to, q) do not intersect at to > 0; they cross each other only in a spin-glass state 
point, TO = and q > 0. Of course the line to = is always a solution of to = M{m, q, f3,a + 7, $). 
For every fixed $ and a + 7 there is a noise threshold at which these two lines are tangent, so a pure state 
solution TO > appears beyond the spin-glass state: We computed all the corresponding free-energies and 
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Figure 5: Left: RS amplitudes of the Mattis order parameter of the pure states at $ = 0.5 as function of 
the noise. From top to bottom: a + 7 = 0.01 — 0.05, {A[a + 7] = 0.01). Right: Solid lines represent free 
energies of the pure states (PS) for a + 7 = 0.01 — 0.05 at <1> = 0.5. Dashed lines represent free energies of 
the spin glass (SG) states for a + 7 = 0.01 — 0.05 at <i> = 0.5. Each different a + 7 is called simply a in 
the plots and each couple of same lines has a different color for comparison. The higher 1//3 of the PS line 
defines /3m point at each a + 7. The PS and spin glass lines cross in the Pc point for each a + 7. 



verified that, for every fixed a+7 and $, the free energy for the spin-glass state is lower than free energy of the 
pure RS state until noise is further lowered, so the pure state that appears among candidate solutions is not 
immediately stable, that is, we are crossing the region of the "spurious states". At lower levels of noise, two 
pure state solutions bifurcate from the former point, both with strictly positive magnetization, mi > TO2 > 
and 9i > (?2 > 0. The second solution {m2,q2), the one with lower magnetization, has always higher free 
energy than the first one or the respective spin-glass state, so can be rejected in the thermodynamical sense: 
Only the higher magnetization pure state is relevant and becomes a global minimum as far as the noise is 
further lowered. 

Lastly we know that in the limit of /3 —> 00 we reach always a pure state with m = 1 and q — \: this 
is verified for each a -I- 7 < 0.138 and whatever $ and can easily be understood by a scaling argument 
on the Hamiltonian f3H{h; ^, $)[^ In order to depict the two first order critical surfaces, we have repeated 
calculations of order parameters and of free-energy in different regions of the space ($, a -I- 7, /3); in particular, 
we have calculated free energies of the pure state and of the spin-glass state solutions collected for different 
values of 01-1-7 and /3, and compared each other to find the lowest: Where they cross we have the onset of 
the transition from one phase to another; in Fig. ([5|, left panel, we show results of the computation of the 
free energy for $ = 0.5 at various a, while the related Mattis magnetization is depicted in the right panel. 
Starting from the low noise limit and decreasing in /3, the Mattis magnetization suddenly disappears in the 
a + 7, $ plane, implicitly defining the critical surface f^Mioi, $), but only for noise further reduced, namely 
on the critical surface /3c{a + 7, $), these minima are the global minima of the free energy (the former are 
dominated by the underlying spin-glass phase, mirroring the spurious land of the neural counterpart) and 
so can be labeled as pure states. 

We can see these boundaries (/3m (a + 7, $) and /3c (a -I- 7, <&)) together, calculated for various values of $ in 
Fig. [6] upper panel. The curve /3m (a -I- 7, $) and fScio: + 7, <&) in the (a -I- 7, $) plane demarcate different 
phases. The phase diagram is depicted for several choices of Finally, the first-order phase diagram for 
/3m (a -1-7,$) and /3c (a -I- 7, $) critical surfaces at various $ all together is shown in Fig.|6] lower panel. The 
phase defined by the /3c surface is the one under which every pure state is recalled stably by the network 

'^^It is straightforward to see that in the /3 — > 00 limit the random field term can always be neglected with respect to the 
Hopfield terms. 
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Figure 6: Left panels: Phase diagrams given by the critical surface I3m at various a (upper panels) and at 
various $ (lower panel). Right panels: Phase diagrams given by the critical surface j3c at various a (upper 
panels) and at various $ (lower panel). As usual, a in the plots stands for a + 7. 



given appropriate initial conditions 
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